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Facilitating Change Through A Simplified R & D Process . 

Researcir"f indings are seldom, put into practice and there are un- 

^ ' J 
doubtedly numerous reasons for this. Bell (1975) suggests that one 

the most important factors is^the 'faUure of R & D personnel to invplve 

program users in tiie early stages of the research process / He further 

points out th^t educational researchers have often chosen inappropriate 

topic? and areas of inquiry rather than focusing on the most urgent and 

pressing needs of students in the classroom *and the decision makers who . 

must determine the types of educational programs tlfcse students receive. 

•The conclusions that Bell (1975) makes would suggest tliat there is a 

need for a new R & D process - a process that would allow researchers to 

coimnunicatfe more effectively with J?oth users and administrators (or 

ftindei^s) - a process that would facilitate the extension of research 

findings^ into actual ptactice. This paper will suggest an R & D process 

which has demonstrated Its utility in addressing ther issues described by 

Bell. Following the description of the process itself, its^iUty will 

be examined by describing its application in an ongoing pi?oject at the 

National Technical Institute for the Deaf. ' • •. 

Description of the Process ■ , , . 

The process suggested in this paper is by intent not complicated^ 
It consists of four primary phases. These -fout phases Represent the ^ ^ 
bifoad sequence of activities necessary for advancing the embryo of an ^ 
Idea into the end goal of actual practice, the, four stages are:- 1) 

* .A* * 

• " • « f 

Research, 2) Development, 3) Implementation, and 4) Maintenance. 
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Evaluation is not listed as a separate stage s£rice it occurs in all 
stages. , Figure 1 depicts the four stages and the relative .pei;cfeatages 
of involvement of R & D personnel and the users for whom the program • 

— ^ 

is being produced. 



insert Figure 1 about here 



T^he absolute values of the percentages are not important in that this 
will change as a^nction of the project and personnel involved. What 
is iiriportant is that the users are involved in all four phases. Their 
involvement should ensure that: 1) the end product will be relevant to 
the needs of the intended audience, 2) the content will be valid > 3) * . 
users vill view the program as "theirs" and hencd, be more willing to 
implement it. „ ^ - - . > ^ 

Within each of the four phas,es are^ a series of subordinate activi- 
ties. In this paper we will not„ attempt to elaborate on those steps^ 
except to say th^t thexphases and associaAd activities are not mutually 
exclusive. Research activities may be conducted during the Development^ 
Phase, development activities, may be carried out during the . Implementlatlon 
Phase and of course, evaluation is carried out in all stages. The 
category labels simply indicate the^elative emphasis of the different 
types of activities. In other words, the Research Phase 'a primary focus 
is research, the Development Phase's, development, and so on. 
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Using the Process 

^ r 
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During^ the past. year the Department of Research and Development at 
the National Technical Institute for the Deaf (NTID) has been testing 
the utility of this process.' oie^^oject^ that, has been conducted using 
the process as a guide ig the tutoring/notetaking' (T/N) project. A 
detailed description of the project has been reported elsewhere (Osguthorpe, 
1976). In the past, two options were available at NTID for providing - 
tutoring and not)|takittg services: • . » 

Option 1: Professionals (master 's^'d.egree level of training) serving^ 
as both tutors ind notetakers . . , ^ . 

Option 2: Professionals serving as tutors and student volunteers as 
notetakers. 

The first option. became prohibitive from, a cost perspective as t^e 
institute increased its enrollment 'from 89 to approximately 900 students. 
The second option resulted in nptes of varying quality dnd decreased 
contact between th0 professionals and cburse instructors. The T/N 
pr'oject was initiated to provide an alternative that would maintain 
quality at a reduced cost* The objective of the pr^oject has been to 
train normal-hearing peer? to tator and take nqtes for deaf college 
students enrolled in regular college classes. ^ ^ 

Before describing the application of the R & D process ta^this pro- 



Ject, it is important to identify, the I'upers".' As is the case with most 
educational prpgrams, the users^.ape composed "of several different groups. 



taciAitalting change 
5 



. } 

In this ptoject four distinct groups of "users" were identified. -'The 
professionals were Considered as the prlinatry group of users in the 
project because it had<-been their responsibility to ;provide tutoring and 
notetaking services and! because the plaH called for them to assume the 
managerial resppnsibilities foi the program once It was aeyeloped. 
Another group of "users" would be the T/N's who would be trained to 
prov:^de the aervice. The T/N's were undergraduate hearing students at 
the Rochester InstiLqte of Technology (RIT) Deaf students must also be 
considered as users'^in this project. Finally-,, administrators who au- 
thorize the expenditures for the program are 1^'a sense users,.- It^^ 
should b? clear af this point that it would be 'impractical to involve _ 
all users in Jhe R&D process. 'What is important is to ensure that each 
group of users iS involved and feels a sense "of participation in the 
.project. Since some groups "of users are usually more central to the 
success of a. program than other groups, it is assumed that these groups 
should be more heavily involved in the R & D process. This ayst^tic 
"involvement of user groups in research and development activities is' in 
direct response to Bell's (1975) in^junction that researchers avoid- the" ^ 
common practice of designing programs and conducting studies in complete 
isolation. *^ 

m 

• in order to" illustrate the effects of the R & D process a summary 
will be^ given .of the T/N .project as it has progressed through the Re- 
•search Development, Implementation and Maintenance phases^ 
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The Res^rch Phasfr 

.lii the Research Piia'se data should be gathered to document an iden- 
»t,ifled need. This data should also provide Inslglit into the most ap- 
proiiriate s'tratfegles for meeting the need. As strategl-es and/or pro- 
grams" are suggested, a thorough review of ' related research^and ^existing •. 
programs should be- completed. In Figure % sample tasks are suggested 
fbr each of the phases, including the Res^rch Phase. These tasks. are 
provided for illustrative purposes and should neitljer be considered as a 
complete list nor as mandatary for all R & D pfoj^cts. In the case of 



insert figure 2 about here 
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the'T/N project the need -for new support options became apparent as 
stj«lent numbers increased and the number of prdf essiongl ataf^ remained . . 

Constant. This identified .need was further assessed by interviewing 

J' 

professional tutors and notetakers. As the need became clear, alternative 
strategies were proposed. The strategy viewed as having the most potential 
for meeting the- established need was based largely on the use of parapro- 
fessionals as tutors and notetakers. Experts in the area of parapro- 
fessional tutoring were invited to NTID in a consultant ro]fe and exist- 
ing literature, in nqtetaking (especially for deaf , stud^tjs) was re- 
viewed. Following these initial steps, it was determined that a train- 
ing program should be developed for the purpose of ensuring that para- 
professionals (normal-hearing peers) would have the necessary skills in 
order, to provide effective tutoring and notetaking se'rvices for deaf 

^ 8- 
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Students, As figure 1 .suggests program users' were mjt heavily involved 

in this phase of the project. They did have input into the nefejls assess- 

ment but "were not responsible for reviewing research or writing pro- 

'posals. These tasks wer.e conducted by the project manager. It is im- 

port^t- to note, however, that the users were fully aware of the T/N 

project and that it was in the Research Phase. This knowledge enabled 

users, administrators, and the T/N project manager to coujmunicate more 

•"effectively concerning the specific roles and responsibilities of each ' 

group. Users knew that their role would become increasingly important 

as the project moyed from research to development.* Administrators^ 

expectations and funding projections were aided because they cbuld^ 

* » 

predict progress and specific task completion with greater accuracy. 

t 

The Development Phase , 

' V 

the^evelopment Phase can best be differentiated from the Res'earch 
Phase by considering the outcomes of each phase. In the Research Phase, 
the outcome caft be characterized as accumulated data'. Some of this" data 
is collected specif icall/^T?rt:- the project and some is reviewed from pre- 
vious research. The form that final write-ups take is completely de- » 
pendent on project needs, but the primary outcome ^ remains as data.* If 
instruments are cbnstructed, they are also designed for the collect'ion 
of data that will lead to program development. The instrument is not ' 
'considered an end iri itself. Tasks for ttie development Phase ayV - 
described in Figure 2.» In each -task, it can be seen that the expected 
6utcome is some type qf intervention program. While data collection ia 
essential in the Development Phase, it is jiot the primary purpose of the 
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phaSe^.. The primary purpose is to produce, an effective instructional 
program that will mee't the needs identified in the Research -Phase . 

As ^he T/N project moved from research to development, users ' 
gradually assumed an increasingly important role. Professional tutors 
and netetakers were asked for sugfestions concerning the ' development of* 
• a training guide for T/N's. Meetings were held with groups of pro- 
fessionals 'as well as separate meetings between the project manager and 
individual tutors. As the T/N guide was written, -prof ess ionals were 
asked for critical feedback and suggestions'. 

Once the T/N guide was complete, the training program was designed. 
Again, ^^essionals and other faculty played a key rol^ in the planning 
and conducting of the training program* After T/N*s had completed the - 
training program, the project manager continued in a supervisory role 
. meeting with T/N^s weekly and suggesting methods for improving their- 
tutoring and notetaking skills. In essence, this constituted the field 
test of, the, T/N concept which was still in ther development stage. 
Professionals w^re involved in the field test, usually as 'scheduling 
coordinators. They knew how inany T/N*s were serving, what students they. 
4 were supporting, and the courses ^hey were covering. It should be 

noted, howevet, that professionals had little direct contact with T/N*s 
♦ 

during the -development phase . \ ' ^ 

At the ^close of the first quarter of the T/N field test, formative 
data were collected from^each of the three populations involved: 1) T/N'a 
themselves, 2) students, and*3) faculty (see Figure 2), The ;j.nput 
obtained from these thr^e groups was used in making revisions in the T/N 
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toanual and training procedures (see Scriven, 1969). It is important to 
note at this point that the T/N project remained an "experimental" 
program throughout^ the Development PKase.' The primary purpose of the 
project during this phase w^© to test the feasibility of the T/N con- • 

cept and refine the program as opposed to providing the needed service. 

1 * y 

4 

Tmplementation Phase ( 

During the Implementation Phase the project is still experimental- 
but the nature of the experiment has shifted. In the Development -Phase 
the experiment is to find a procedure that will work in controlled 
"circumstances. In the ^mplementatljon Phase~thkt pjrbcedure whicli worked 
in a controlled environment is now- tested, in the "real world" with all 
the users |flr whiom it was designed. The project director's role is one 
of evaluaCjLon & revision, not one of direction". 

At the vnriting of this paper, the T/N program is nearing the end of 
the Implementation Phase. The 'T/N manual has undergone extensive revi- 
sion based on the formative data, several professionals in different 
^ colleges have assumed full management responsibility, and the purpose of 
the program is gradually shifting from experimental in nature to' that of 
providing service to students. This shift in purpose is important for 
two reasons. First, it is a signal that the program" is being .conducted 
as it was originally envisioned and therefore mu&t be carefully evaluated, 
The eva],uatiqn should be summative in nature - comparing the effects of 
the program with iome 'other alternative. It would hav6 been inappro- 
priate to gather thig type of data earlier when the program was in 
embryo because the data might have been misleading. For example, if 
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the data were -positive, it could be attributed to the artificial manage- 
*ment scheme and monitoring proceduues that change during tj}e Implementa- 
tion iphase, . ' , . 

Summative data, then, should be gathered when the program is in ' 
transition from an experimental ,8tudy to an institutj'e-wlde system that ^ 
has been assimijLated by users ^and has,* in effect, become "theirs." The 
T/N program^ is, now near the end of that* transitory phdse, ^Managers have 
begun to think of the program as -their own. They ai:e testing its effec- ^ 
tiveness with a variety of students in a variety of courses, They 
continue to provide hfelpful* input concerning changes and augmentations 
that would improve the program's utility. * ' - 

Maintenance Phase ' - ' * . ' 

-If the summative data collected in the Implementation Phase in- 
dicate^ that a program is meeting the needs for" which it va6 developed, 
the jirogram'will ^enter the Maintenancfe Phase. In the Maintenance Phase 
R 6t D personnel assume a less important role in the program but continue , 
to monitor its effects and make recommendations to program nlanagers. If , 
it is determined that the program is no longer meeting the intended ^ 
needs, or if the experimehtal environment changes and the original needs 
>4i88ipate, R&D personnel may conclude that the program should be 
discontinued. Additional R&D maintenance tasks are described in ^ 
Figure 2. ^ . ^ 

After summative data have been collected on the T/IT program, a 
decision" will be made concerning the program's future. If the data show 

V 
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that the program is meeting the nee'ds* originally identified, the program 



will enter the 
/assume' all? of 



the Miaintenance Phase. In the Maintenance Pfljfee^ users, will 



the respopi^ibilities. associated with tl\e management and . 



"training aspects of the >rogr^. R & D personnel will assume a less , 

^d.sible ^fole, but will still be involved in the datS collection needed 

' - ^ ^ ' ' \ ' 

to ensure^ that consistently hi'giier quality support services are. being 

^ delivered. -The' mechanisms for collecting such dajta will largely tie 
' integral to the program at this potnt rather th^n\auxiliary to it. 
This data might best be caLled system monitoring dat^.Csee Figure 2). 

\_By gathering this type, of infomation, it is anticipated that program 
- improvements will continue as long^f^s^he program is adfliinistered . 

-' - • : / ■ . 
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'Conclusion^ 



*The tfesults of the T/N projwt wouj^ suggest that the four phase 
process can enhance the probability of 'bringing about innovation through 
rese^tch and development efforts • That .i^^pot to .say that the pi^ocess 
precludes the^ocpurrenc.e of difficulties. It should be noted that the 

T/N project did 'encounter Some resistance. It should also be noted, 

r 

however, ^that the problems that developed in the T/tl project could 
usually be attributed to* poor communication bet?3een the R & D staff and 
the^users. Part of this communication cojisi^ted of role clarification* 
It was found that when R&D staff and administrators to6k time to 
clarify rolbs using the model, ^sers and reseax'chers had congruent 
expectations. 

, There is no question tSat when R&D personnel use the four phase 
mode^^ projects -are completed at a slower rate. Involving users and 
administrators in the decision makisig*prQGesses takes time. The trade- 
off is the ^eater assurance that R ^^^jj^ ndings will actually result in 
improved practice. In the opiryion of the authors, the tr6de-off is 
worth it. ' . ^ * 
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Facilitating Change Through A Simplified R &*D Process (EVA) 



RUSSEEL^T. OSGUTHORPB 



) 

^ ' ^ tSLO 'E. BISHOP 

National Technical rn8;:itute for the-Deaf 

A foui; phase process is described ^^hich is designed to did R&D 
^ personnel in their attempt to institute change in educational practice* 
The four .phases include: 1) Research, 2) development, 3) Implementatijfon 
and 4) Maintenance. Emphasis is placed on increasing "user** involvement 
wifhitt each st^ge of the process. Results are given of an R & Q,' project 
which nised the four phase process a.s a guide* .The results show that the 
proceoB can be v^^^^^^^\:^'tB and-^administrators, as well as R & *D 
personnel. " ' - . 
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Figure Captions 



^ Figure 1. A four^hase process showing the percentage 
of/ involvement of users and R&D personnel. 



Figure 2/ Sample tasks emphasizing the r5le of 
eval^ation in eadh of the four phases of the R & D process. 
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Research 



Devetopment {mplementation Maintenance 



> Review existing research 
titerature 



• Rev)ew available 
training programs 



• Review exsting , 
me^urernent 
Ktstrumeots 



» Design 
measurement 
mstrtiments 



• Gather descnptive (tela 



• Design and conduct 
experimental 
stupes > 



• Determine program 
, objectives 

• Identify and organize 
coment 

• involve content experts , 

• Select instrtK:tiona( 
strat^*es 

• identify appropnate 
delivery syslem(s) 

• Discuss content, strategy 
and delivery sy^em 
proposals with users 

• Destgn format specif}/ 
cations for materials^ 
to be developed 

• Produce ^nstructKXWl 
package (manuals media 
si^ports. etc ) 

• iJ^^gn mar^gement system 

• Field test v^th users 
program segments as tt^ 
are completed 

• Field test entire orogram 
^th L^ers on hmited scale 



r • Explain program obfectrves 
to total user bbpula^ 

• Expia^ use^if roie(s) tn 
progra^im^ementation 

1 • Recruitlwiional peryonr«l * 
if r>ecessary 

• Tram program managers, proctors 
or tutors, etc 

• Schedule inservice tra}r)fr)g 

• Sc^.3dule studeni/program 
contact 

• Determrte pay scale ^ 

• Project future lunding 

• Perform analyses 

• Refine n^nagement system 

• Refine program 



• Review personnel 
need^ 

• Expand or reduce 
' pro^^amlf 

necessary 

• Review cost analyses 

• Make minor 
pfo^am revisions 



NgPS ASSESSMENT FORMATIVE EVALUATION SUMMATIVE EVALUATION SYSTEM MONITORING 



Should a program be 
dkveloped^ 

If so. v(^t needs ^xwW 
It address^ 



How can ihe program be 
improved^ 



What IS the worth of 
trie program'? 
Should the program be 
continued^ 



Is the program continuing 
to meet the ongtnal 
objectives'^ 



